Search for: All records

Traffic signal controller (TSC) has a crucial role in managing traffic flow in urban areas. Recently, reinforcement learning (RL) models have received a great attention for TSC with promising results. However, these RL-TSC models still need to be improved for real-world deployment due to limited exploration of different performance metrics such as fair traffic scheduling or air quality impact. In this work, we introduce a constrained multi-objective RL model that minimizes multiple constrained objectives while achieving a higher expected reward. Furthermore, our proposed RL strategy integrates the peak and average constraint models to the RL problem formulation with maximum entropy off-policy models. We applied this strategy to a single TSC and a network of TSCs. As part of this constrained RL-TSC formulation, we discuss fairness and air quality parameters as constraints for the closed-loop control system optimization model at TSCs calledFAirLight. Our experimental analysis shows that the proposedFAirLightachieves a good traffic flow performance in terms of average waiting time while being fair and environmentally friendly. Our method outperforms the baseline models and allows a more comprehensive view of RL-TSC regarding its applicability to the real world. 

Dicrotic Notch (DN), one of the most significant and indicative features of the arterial blood pressure (ABP) waveform, becomes less pronounced and thus harder to identify as a matter of aging and pathological vascular stiffness. Generalizable and automatic DN identification for such edge cases is even more challenging in the presence of unexpected ABP waveform deformations that happen due to internal and external noise sources or pathological conditions that cause hemodynamic instability. We propose a physics-aware approach, named Physiowise (PW), that first employs a cardiovascular model to augment the original ABP waveform and reduce unexpected deformations, then apply a set of predefined rules on the augmented signal to find DN locations. We have tested the proposed method on in-vivo data gathered from 14 pigs under hemorrhage and sepsis study. Our result indicates 52% overall mean error improvement with 16% higher detection accuracy within the lowest permitted error range of 30 ms. An additional hybrid methodology is also proposed to allow combining augmentation with any application-specific user-defined rule set. 

Despite recent promising results on semi-supervised learning (SSL), data imbalance, particularly in the unlabeled dataset, could significantly impact the training performance of a SSL algorithm if there is a mismatch between the expected and actual class distributions. The efforts on how to construct a robust SSL framework that can effectively learn from datasets with unknown distributions remain limited. We first investigate the feasibility of adding weights to the consistency loss and then we verify the necessity of smoothed weighting schemes. Based on this study, we propose a self-adaptive algorithm, named Smoothed Adaptive Weighting (SAW). SAW is designed to enhance the robustness of SSL by estimating the learning difficulty of each class and synthesizing the weights in the consistency loss based on such estimation. We show that SAW can complement recent consistency-based SSL algorithms and improve their reliability on various datasets including three standard datasets and one gigapixel medical imaging application without making any assumptions about the distribution of the unlabeled set. 

Abstract In this paper, we study the L 1 / L 2 minimization on the gradient for imaging applications. Several recent works have demonstrated that L 1 / L 2 is better than the L 1 norm when approximating the L 0 norm to promote sparsity. Consequently, we postulate that applying L 1 / L 2 on the gradient is better than the classic total variation (the L 1 norm on the gradient) to enforce the sparsity of the image gradient. Numerically, we design a specific splitting scheme, under which we can prove subsequential and global convergence for the alternating direction method of multipliers (ADMM) under certain conditions. Experimentally, we demonstrate visible improvements of L 1 / L 2 over L 1 and other nonconvex regularizations for image recovery from low-frequency measurements and two medical applications of magnetic resonance imaging and computed tomography reconstruction. Finally, we reveal some empirical evidence on the superiority of L 1 / L 2 over L 1 when recovering piecewise constant signals from low-frequency measurements to shed light on future works. 

Recent advances in Critical Congenital Heart Disease (CCHD) research using Photoplethysmography (PPG) signals have yielded an Internet of Things (IoT) based enhanced screening method that performs CCHD detection comparable to SpO2 screening. The use of PPG signals, however, poses a challenge due to its measurements being prone to artifacts. To comprehensively study the most effective way to remove the artifact segments from PPG waveforms, we performed feature engineering and investigated both Machine Learning (ML) and rule based algorithms to identify the optimal method of artifact detection. Our proposed artifact detection system utilizes a 3-stage ML model that incorporates both Gradient Boosting (GB) and Random Forest (RF). The proposed system achieved 84.01% of Intersection over Union (IoU), which is competitive to state-of-the-art artifact detection methods tested on higher resolution PPG.